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DUALITY  IN  HOMOGENEOUS  PROGRAMMING 


The  problem  of  maximizing  a  concave  function  subject  to  linear  con¬ 
straints  does  not  have  a  dual,  as  is  the  case  in  linear  programming,  in 
which  primal  optimizing  variables  do  not  appear.  As  a  special  case  of  our 
principal  result  it  will  follow  that  such  a  dual  does  indeed  exist  whenever  the 
objective  function  is  also  homogeneous. 

*  n 

In  the  linear  case  we  are  given  an  m  x  n  matrix  A  and  vectors  aeR  , 
beR^.  The  feasibility  sets  X  and  Y  are  defined  by:  X=R^rv{x|xA<  a}  , 

Y  =  R^  O  (y|Ay  >  b)  .  Since  xA  <  a  if  and  only  if  xAy  <  ay  for  all  yeR^ 
(and  similarly  for  Ay  >  b),  we  may  write: 

X  =R’^p^/x|xAy  <  il>{y)  all  yeR^l 

(1)  .  ^  I  “ 

Y  =  n  |y|xAy  >  <})fx)  all  x  e  R’^  j 
where  0  fy)  =  ay  and  <t)fx)  =  bx. 

A  fundamental  theorem  of  linear  programming  (see,  e.g.  ,  [3]  and  [5]  ) 
states  that  if  X  and  Y  are  both  non-empty  then 

(2)  max  cf’fx),  min  01y)  exist  and  are  equal  . 

X  €  X  y  €  Y 

We  propose  to  demonstrate  that  (Z)  holds  for  larger  class  of  triples  IA,4> ,  i//)  . 


R^  denotes  the  set  of  all  real  m-tuples.  If  u,  v  t  R^  then  u  ^  v  means 
that  the  inequality  holds  for  each  component.  In  particular,  r’^  = 

=  r”^  ^{x|x>0).  IfMisapxq  matrix  and  N  is  a  q  x  t  matrix  then  M 
N  represents  the  usual  matrix  product.  To  simplify  notation,  the  same 
symbol  is  used  for  both  a  column  vector  and  its  transpose;  the  meaning 
will,  in  any  case,  be  clear  from  the  context. 


V  - 


Assumption  A^.  Let  tj>  :  “*’R.  ^  -^R  be  positively  homo- 
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geneous  ,  continuous,  concave  and  convex  respectively. 

Let  us  first  show  that  A^  does  not  guarantee  that  (2)  holds  when  X  and 

Y  are  non-empty.  If  m  =  2,  n  =  1  and  A  =  J  =  <|>(€,tj)  =  — — , 

[<|)(0)  =0],  iij{y)  =y  then  Aj  is  satisfied  and  X  =R^n|(€,r))|  H  £  1 f 

Y  =R.n  y|y  >  1  are  non-empty.  Thus  min  0(y)  =  1,  but  if  r)  <  1  then 

^  *  y  e  Y  ~ 

although  sup  <j*(x)  =  1,  hence  max  <{>(x)  does  not  exist. 
xeX  X  e  X 

The  situation  just  illustrated  cannot  occur  if  the  following  holds: 


Assumption  A^. 

i)  If  xeR^,  xA  <  0,  <}>(x)  >  0  then  x  =  0 
ii)  If  y  e  R^  ,  Ay  >  0,  ^(y)  <  0  then  y  =  0 


One  sees  immediately  that  {i)  is  violated  in  the  preceding  example,  for  let 
X  =  (1,0)  then  xA  =  0  and  4>fx)  =  0. 

Before  proving  that  if  A^  and  A^,  hold  then  so  does  (2),  we  require  the 
following  lemma  which  specializes  to  homogeneous  functions  the  well-known 
fact  that  a  concave  function  is  the  inLmum  of  its  supports.  The  proof  is  pre¬ 
sented  here  for  the  sake  of  completeness. 

Lemma  1.  Let  <|)  be  as  in  assumption  A^,  consider 

T  =  R^n  I  tjtx  >  <t>(x)  ail  X  e  R^l ,  then  T  is  non-empty,  and  c|)(x)  =  inf  tx, 

^  ’  teT 


for  all  X  e  R“  . 

Proof.  Let  C  =  |  (x  ,  X) )  x  e  R*^  ,  X  <  <)5(x)|  then  C  is  a  closed  convex 
cone.  Now  if  XqCRI^,  p  >  0,  then  (x^,  p  +  <J>(Xq)  ^  C,  whence  (see  [2],  Theorem  1) 

^  Q  O 

A  function  f  :  C  -♦R^,  where  C  c  R^  is  a  cone,  is  positively  homogeneous 
providing  f{Xx)  =  Xf(x)  for  all  xeC  and  X  e  R^  . 
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there  exist  t  e  and  ae  R  such  that  tx^  -  a[  (j.  +  c^Xq)]  <  0  <  tx  -  aX.  all 
(x.\)  eC. 

It  then  follows  that  a  >  0,  so  that  (dividing  by  a)  we  naay  assume 
Q  =  1,  but  then  t  eT.  Reiterating,  if  XqCR^,  ji  >  0  then  3t  e  T  such  that: 

giving  the  desired  result.  We  are  now  able  to  prove: 

Theorem  1.  If  assumptions  and  hold  then  (2)  holds. 

Proof.  Let 

-  o 

S  =  R^n  -|s  I  sy  <  0  (y)  ^  all  y  €  R^ 

(3)  ^ 

T  =  R^Vl-^ltx  >  (^{x)  ^  all  X  e  R^ 

Then  S  and  T  are  convex  sets;  now  consider  the  system  of  inequalities: 

(4)  (x.y,  s,t)  e  R^  X  xs  X  T 

s  -  xA  >  0 
-t  +  Ay  >0 
4)(x)  -  Ip  iy)  >0 

If  (4)  has  a  solution  x,  y,  s,  t  then 

ipiy)  <  <t>(x)  <  tx  <  xAy  <  sy  <  ^^'(y)  • 

which  IS  a  contradiction.  Thus  (see  [2],  Theorem  1)  there  exist  Xq  e  R^  , 
yQ  e  r”,  X  e  R^,  not  all  zero  and  such  that  (s  -.xA)yQ  +  XQ(Ay  -  t)  +  X[  4)(x)  -^//(y)]  £ 
<  0  for  all  X  e  R^,  yeR^^,  seS,  teT.  From  the  homogeneity  and  continuity 
of  4>  and  ip  it  then  follows  that: 
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xAyq  >  X.4>(x)  ,  all  xeR^ 

XqAy  <  X0(y)  ,  all  y^R” 

syq  £  txQ  ,  all  seS,  teT 

O 

The  last  condition  together  with  Lemma  1  imply: 

0(yo)  1 

Now  if  X  =  0  then  either  Xq  ^  0  or  Yq  0  and  Ayq  >  0,  XqA  <  0. 
Suppose  Xq  ^  0,  if  Yq  ^  0  the  argument  is  analogous,  then  by  A2(i)  we  have 
<j)(xQ)  <  0,  whence  'PWq)  <  0  and  y^  ^  0,  contradicting  A^(ii).  Thus  X  >  0 
and,  dividing  all  inequalities  by  X,  we  may  assume  X  =  1.  This  tells  us  that 
XqCX,  Yq  €  Y  and  ‘I’Ixq)  <  XqAyq  <  MVq)  £  xeX,  yeY  then 

<^(x)  <  xAyq  <  (//(Yq)  =  4>(xq) 

<Piy)  >  ^qA-y  >  <))(xq)  =  (p{yQ) 

proving  the  theorem. 

In  case  cf  and  are  linear -homogeneous  then  it  is  true  that  max  <j>{x) 

xeX 

exists  if  and  only  if  min  ipiy)  exists,  in  which  case  they  are  equal.  As  above, 

yeY 

this  statement  is  not  always  true  under  assumption  Aj',  however,  we  show: 
Theorem  2. 

I)  If  A ,  and  A  (ii)  hold,  and  max  <j>(x)  exists  then  (2)  holds. 

xeX 

II)  If  and  ^2(1)  hold,  and  min  exists  then  (2)  holds. 

yeY 

We  prove  (I),  the  proof  of  (II)  is  similar.  Suppose  that  Xq  e  X  and  ‘I’(xq)  = 

=  max  4>(x)  then  the  system: 

X  e  X  ^  • 
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(6) 


(x.  s)  e  R"‘  X  s 
s  -  xA  >  0 
<t>{x)  -  ‘|>(xq)  >  0 

has  no  solution.  Thus  (see  [2],  Theorem  1)  there  exist  y-geR^,  X.eR^, 
not  both  zero  and  such  that 

sy-Q  -  xAyg  +  X.[  4)(x)  -  <|>(xq)]  <  0  for  all  x  eR^,  seS.  From  the 
homogeneity  of  <}>  and  Lemma  1  it  then  follows  that 

xAy_  >  X.4)(x)  ,  for  all  x  e  R^ 

(7)  ^  -  + 

HYq)  1  ^<t>(XQ) 

Now,  if  X  =  0  then  y^  ^  0  and  Ay^  >  0,  ^/'(yg)  <  contradicting  A2(ii). 

It  may  then  be  assumed  that  X  >  0  and,  in  fact,  that  X  =  1  (replacing  y^  by 
Xyg).  Thus,  from  (7),  y^  eY,  and  for  any  y  eY  we  have; 

’ 

i.e.,  ■  q-e.d. 

y  e  Y 

It  should  be  remarked  that  if  A^  holds  then  (i)  and  (ii)  of  assumption  A^ 
are  equivalent  to  (i)'  and  (ii}'  respectively  of: 

Assumption  A^. 

i) '  3  Yg  ^  ^  ^  ^  ^  ,  X  ^  0 

ii)'  ^XgeR'J^  ^XgAy  <i^(y)  all  y  €  r'J  ,  y  ^  0 

These  in  turn  are  equivalent  to  the  familiar  conditions  that  X,  Y  have  non¬ 
empty  interiors.  To  see,  for  instance,  that  (i)  and  (i)'  are  equivalent  it 
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suffices  to  show  that  (i)  implies  (i)'  since  the  implication  in  the  other  direc¬ 
tion  is  trivial.  Assuming  (i)'  false,  the  system 

(8)  (y.t)eR"xT 

Ay  -  t  >  0 

has  no  solution,  whence  (see  [2],  Theorem  1)  there  is  an  x  eR^,  x  ^  0  ,  and 
such  that  xAy  <  tx  for  all  y  e  r”  and  teT.  Thus  xA  <  0  and  (using 
Lemma  1)  <t>(x)  >  0,  contradicting  (i).  To  return  to  our  remark  about  maxi¬ 

mizing  a  concave  homogeneous  and  continuous  function  4^ :  R^  R,  subject 
to  the  inequalities  x  >  0  and  xA  <  a,  the  dual  is  then;  minimize  ay  subject 
to  yeY.  Conditions  (i)  and  (ii)'  become: 

xeR^,  X  ^  0,  xA  <  0,  4>(x)  >  0  has  no  solution;  and 

xeR^I^,  xA  <  a  has  a  solution;  respectively. 

Also,  since  yeY  providing  y  >  0  and  Ay  >  t  for  some  support  t  of  4*. 
we  may  characterize  Y  by  means  of  the  gradient  of  4- 

Results  similar  to  Theorems  1  and  2  can  be  shown  to  hold  under  other 
and  somewhat  less  restrictive  assumptions;  the  duality  theorems  of  linear 
programming  then  turn  out  to  be  special  cases  of  these  theorems  (3,  4  and  5). 
Henceforth  we  assume  that  A  j  holds  and  consider  the  sets; 

j(x,  Y,X)j3  seS,  teT,  x  e  R^  y  e  R"  and 

X  >  t  -  Ay,  y  <  s  -  xA,  \  <  4>(x)  -  Mv)  ^  ^ 

=  R^^  I  (y^  X>  I  3  s  e  S,  X  e  y  <  s  -  xA,  \  <  ct>(x)1  ^ 

K3  =  ^(x,\)l3  t  eT,  y  eR^,  and  x  >  t  -  Ay.  \  >  (//(y)j  . 
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The  sets  K^,  K^,  and  are  readily  seen  to  be  convex  (because  ijj  and  -  <|5 
are  convex);  furthermore,  if  4>  and  0  are  linear  then  and  are 

also  closed  sets.  Of  course  any  (or  all)  of  K^,  K^,  may  be  closed  with¬ 

out  either  ^  or  tj/  being  linear.  Thus  it  is  important  to  know  the  following: 
Theorem  3. 

If  Kj  is  closed  and  X,  Y  are  both  non- ■'mpty,  then  (2)  holds. 

Theorem  4. 

If  K,  is  closed  and  max  4>(x)  exists,  then  (2)  holds. 

xeX 

Theorem  5 . 

If  K  is  closed  and  min  ^i/{y)  exists,  then  (2)  holds. 

y€Y 

Proof  of  Theorem  3:  If  the  point  (x,  y,X)  =0  is  in  then  (2)  obviously 
holds,  suppose  0  i  Since  is  convex  and  closed,  there  exist  (see  [3]) 

XqCR^,  y^eR^,  XqCR,  aeR,  such  that: 

0  <  a  <  XqX  -  y^y  -  all  (x,  y,  X.)  eK^ 

Since  S  and  T  are  non-empty  (see  Lemma  1),  and  since  (x,  y,\)eKj  when¬ 
ever  there  exist  (xjy,X.)eKj  such  that  x  >  x,  y  <  y  and  \  <  X.,  it  follows 
that  Xq  >0.  Yq  ^  and  >  0.  Also, 

0  <  a  <  Xq  (t  -  Ay)  -  (s  -  xAly^  -  [<i>(x)  -  ^('(y)]  , 

all  {s,t,  x,  y)eS  x  t  x  x 

From  the  homogeneity  of  <|>  and  ijj  and  Lemma  1  it  then  follows  that: 


o 

A 

P 

< 

4>(xq)  - 

XQAy 

< 

all  y  e  R 

xAyg 

> 

^■Q  <t>  (x) 

all  X  e  R 
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Thus,  -  ^0  -  ^0  ^0  ~°' 

XqA  <  0  and  Ay^  >  0.  Now  X,  Y  we  assumed  non-empty,  let  xeX  yeY. 
For  any  X.  c  R^  we  then  have: 

o 

<j>(x)  +  X<t>(xQ)  <  (j>(x  +  Xxq)  <  (x  +  XxQ)Ay  < 

<  (x  +  XxQ)A(y  +  Xy^j)  <  xA(y  +  Xy^) 

<  ipiy  +  Xy^)  <  \P(y)  +  X^//(yQ)  . 

Thus,  ^i/(y)  -4>(x)  >  X[<))(xq)  -  (^'{yQ)]  >  X  a  for  all  X  e  which  contradicts 

a  >  0.  Thus  0  e  K.  and  (2)  holds.  q.  e.  d. 

^  * 

Proof  of  Theorems  4  and  5:  We  prove  Theorem  4,  the  proof  of  Theorem  5  is 
analogous.  By  hypothesis  X  is  non-empty  and  (|>  is  bounded  above  on  X,  let: 

M  =  sup  «t>(x) 

X  c  X 

If  (x,  X)  =  (0,M)  is  in  then,  trivially,  (2)  holds.  We  show  that  the 
contrary  assumption  leads  to  a  contradiction.  If  (0,  M)  i  then,  as  in  the 
proof  of  Theorem  4,  it  fellows  from  the  various  properties  of  that  there 

exist  Xq€R^,  XqCR^  and  aeR  such  that' 

XgM  <  a  <  x^lt-Ay)  +  XQ^(y),  all  (t,  y)  T  x 

Hence,  as  before, 

XgAy  <  XQ^i/(y),  all  y  €  R^ 

and  *^(*0)  ^  ^0^  ' 
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If  Xq  is  positive  then  x  =X'^XQeX  and  <t<x)  >  M,  contradicting  the  definition 
of  M.  Thus  Xq  =  0,  and  XqA  <  0,  ‘t>(xg)  >  0;  the  last  contradicts  the  fact 
that  X  is  non-empty  and  that  4*  bounded  above  on  X.  q.e.d. 

As  a  final  result  we  demonstrate  that  if  4>  and  ijj  are  both  linear  (homo- 
geneous)  then  is  closed.  That  and  are  closed,  under  the  same 
linearity  hypothesis,  follows  in  a  similar  manner. 

e 

Suppose  4*(x)  =  bx,  4Ay)  -  (h  e  R^,  aeR*^)  ,  first  note  that  in  this 

case: 

S  =  ^  s  ^  s  e  R*^  and  s  <  a 
T  =  -ft  I  teR”^  and  t  >  b 


Next,  suppose  we  have  a  sequence  (Xj^,  y^^,  Xj^)eKj^  (k=  1,  2,  .  .  .)  which 


n 


converges  to  (x,  y,  X)€  .  Thus  there  exist  ^  ®  xTxR^xR" 


such  that: 

(9)  —  ®k  ”  ^  ~  k  =  1,  2,  ... 

Xj^<  bxj^  -ayj^ 

and 

(10)  —  x,  y*  ^k  ^  ' 

Now,  suppose  xeR^,.y€R^,  ae  R^  are  such  that  Ay  -  ab  >  0,  xA  -  aa  <  0. 
From  (9)  it  then  follows  that  for  each  k  we  have: 


X  >  bx  -  5^yj^  >  bx  -  o.a-yj^  >  bx  -  cihXj^ 


aX,  > 
k  — 


>  bx  +  -  x,^A.y  >  bx  +  oiXj^  +  y^^y  -  ay  . 
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k  =  1,  2,  ...  and,  by  (10), 


i.  e.  ,  x(3Cj^  -  b)  +  y{a  -  yj^)  -  aXj^  >  0, 

x(x  -  b)  +  y(a  -  y)  -  a\  >  0. 

In  summary,  then,  the  system: 

X  €  ,  y  c  R^  ,  ae  R^ 

a  Ay  -  ab  >  0,  xA  -  aa  <  0 

x(x-b)  +  y(a  -  y)  -  aK  <  0 


has  no  solution.  It  follows  then  from  the  ordinary  feasibility  theorm  for 
linear  inequalities  (see  e.q.[5])  that  there  is  an  xeR^  and  ycR 
such  that:  • 

<  (a  -y,  X  -  b,  -X.), 


(x,  y) 


A  0 


i.e.,  xA  <  a  -  y,  -Ay  <  x  -  b  and  ay  -  bx  ^  -X.  But,  as  noted  before, 
aeS  and  beT,  thus  (x,y,X)eK,  and  Kj  is  closed. 
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